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Abstract —Steady-state solutions for a variety of relevant 
queueing systems are known today, e.g., from queueing theory, 
effective bandwidths, and network calculus. The behavior during 
transient phases, on the other hand, is understood to a much 
lesser extent as its analysis poses significant challenges. Con¬ 
sidering the majority of short-lived flows, transient effects that 
have diverse causes, such as TCP slow start, sleep scheduling 
in wireless networks, or signalling in cellular networks, are, 
however, predominant. This paper contributes a general model 
of regenerative service processes to characterize the transient 
behavior of systems. The model leads to a notion of non¬ 
stationary service curves that can be conveniently integrated into 
the framework of the stochastic network calculus. We derive 
respective models of sleep scheduling and show the significant 
impact of transient phases on backlogs and delays. We also 
consider measurement methods that estimate the service of an 
unknown system from observations of selected probe traffic. 
We find that the prevailing rate scanning method does not 
recover the service during transient phases well. This limitation 
is fundamental as it is explained by the non-convexity of non¬ 
stationary service curves. A second key difficulty is proven to 
be due to the super-additivity of network service processes. We 
devise a novel two-phase probing technique that first determines 
a minimal pattern of probe traffic. This probe is used to obtain 
an accurate estimate of the unknown transient service. 

I. Introduction 

The majority of flows in today’s computer networks are 
short-lived [l] and hence dominated by various transient 
effects that can have a significant impact on their performance. 
Relevant examples include TCP slow start jT), where the 
size of the initial congestion window has been repeatedly 
under debate [2j, the convergence of routing protocols, power 
saving in wireless networks using polling, or signalling and 
discontinuous reception in cellular networks |3j|. 

The performance analysis of transient phases causes, how¬ 
ever, fundamental difficulties and queueing theory offers so¬ 
lutions mainly for the steady-state. As an example consider 
the basic M|M|1 queue, where the stationary state distribution 
follows readily from a set of linear balance equations, e.g., |4|. 
The transient behavior, on the other hand, is expressed by 
a set of differential equations for which mainly approximate 
or numerical solutions are known ©■ As a consequence, 
analytical works on transient effects in computer networks are 
sparse @-(8) and often tailored to specific problems like TCP 
congestion control 0. 

A theory that does without an assumption of stationarity 
is the deterministic network calculus 0 , m- It employs 
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envelope functions of possibly non-stationary processes to 
analyze the worst-case behavior of systems. Hence, it takes 
transient phases into the consideration. Once the worst-case is 
achieved, it can, however, not predict how a system progresses. 
We explain this effect and present an example in Sec. |II-A| 
The stochastic network calculus fT0[-||T8l, on the other hand, 
typically either assumes stationarity or uses stationary bounds. 

In this work, we use the notion of time-variant systems G9> 


||20| to model non-stationary service characteristics. Time- 


variant systems are described by bivariate instead of univariate 
functions to consider changes over time. We show that non- 
stationarity can be dealt with in the stochastic network calculus 
using a similar notational extension. We contribute a non- 
stationary service curve model that characterizes the service 
of systems during transient phases. While many known results 
are recovered for the extended model, certain fundamental 


properties such as commutativity [19] differ. We derive solu¬ 
tions for systems with sleep scheduling, provide insights into 
the transient behavior, and quantify the considerable transient 
overshoot. Secondly, we examine methods for estimation of a 
system’s service curve from measurements of probe traffic. 
We refine known measurement methods for estimation of 
non-stationary service curves, where we encounter additional 
difficulties that are attributed to the non-convexity and super¬ 
additivity of the service. We devise a novel minimal probing 
method that estimates a non-stationary service curve and 
provides a measure of accuracy. 

The remainder of this work is structured as follows. In 
Sec. [H] we define non-stationary service curves, show a 
method for construction, and derive models of systems with 


sleep scheduling. In Sec. Ill we investigate the measurement- 
based estimation of non-stationary service curves. We reveal 
difficulties that arise and devise a new minimal probing 
method. We discuss further related works in the respective 
sections. Sec. [TV] presents brief conclusions. While we restrict 
the exposition to non-stationary systems, we note that non- 
stationary traffic can be dealt with in the same way. 

II. System Model 

In this section, we derive a model of non-stationary service 
curves (Sec. II-B| i that enable analyzing the performance of 
systems during transient phases. The basis of this model is a 
definition of regenerative service processes (Sec. |H-A| ), where 
regeneration points mark the start of new transient phases. We 
include solutions for sleep scheduling and show its impact on 
the performance. 












A. Regenerative Service Processes 

We consider a system with cumulative arrivals A(t), where 
A(t) denotes the number of bits that arrive in the time interval 
(0, t]. By convention, there are no arrivals for t < 0 so that 
we generally consider t > 0. Clearly, A(t) is a non-negative, 
non-decreasing function, and A(0) = 0. Shorthand notation 
A(t. t ) = A(t) — A(t) is used to denote the arrivals in (r, t] 
where t > r > 0. Trivially, A(t, t) = 0 for all t > 0. Similarly, 
D(t ) denotes the cumulative departures from the system. 

The service that is provided by the system is characterized 
by a time-variant service process S(r,t) that establishes the 
departure guarantee [10), m-m 

D(t) > inf {A(t) + S(t, t)} =: A <g> 5(f). (1) 

r£[0,t] 

By convention, S(r,t) is non-negative and S(t,t ) = 0 for all 
t > 0. The operator C that is defined by 0 is known as 
convolution under a min-plus algebra 0. (TO). We note that 
(g> is associative but not commutative in general. Examples 
of 0 include a work-conserving server with a time-variant 
capacity [ 101 where S(r,t) denotes the service that is avail¬ 
able in the interval (r, t]; scheduling with cross-traffic [14]; 
and networks of systems where the network service process 
S' net (r, t) is computed from the service processes S l (r,t) of 
the individual systems i = 1... n by recursive insertion of 0 
as S net (r,t) = S 1 ® S 2 ® • ■ ■ 0 S n (r,t ) |l0|. The service 
guarantee 0 enables the derivation of performance bounds. 
An upper bound of the backlog B(t) = A(t) — D(t) follows 
by insertion of 0 as 

B(t) < sup {A(r,t) - S(r,t)}. (2) 

tE[0 ,£] 

Similarly, the delay defined as W(t) = inf{w > 0 : A(t) < 
D(t + u>)} can be considered. 

Throughout this work, we assume that the service is 
a regenerative process |4j with regeneration points P = 
{Po, Pi, P 2 ,...} where P 0 = 0 and P, < P i+ i for all i > 0. 
We divide S(r,t) into segments 

Si(r,t) = S(t + Pi,t + Pi) (3) 

for all 0 < r < t < P,; +1 — P, and i > 0, where Si(j, t) is the 
service process between the zth and the ii + l)th regeneration 
point. The defining characteristic of a regenerative process is 
that the Si(r,t) are statistical replicas, i.e., 

P[Si(r,t) <x] = P [Sj (t, t) < x] (4) 

for all i,j , x > 0, and 0 < r < t < min{P i+1 — 

Owing to 0. we omit the index i in the sequel. Also, we will 
not explicitly mention the constraint t < and assume that 
the next regeneration point P (+1 is spaced sufficiently apart. 

Deterministic Sleep Scheduling: We present a first appli¬ 
cation to sleep scheduling, where we consider a transmitter 
and a receiver that if idle go to sleep state according to a 
defined protocol. Wake up is scheduled deterministically, T 
units of time after entering the sleep state. The transmission 
rate in sleep state is zero and otherwise it is R. Clearly, each 


transition to sleep state is a regeneration point and the time- 
variant service process follows for t > t > 0 as 

f0, t < T 

S(r,t) = l R(t-T), t > T,t < T 
[p(f —r), t>T,r>T 

so that 

S(t, t) = [R(t — max{r, T})] + (5) 

where [a"] + = max{0,x} is the non-negative part of x. 

For numerical evaluation we use a discrete time equivalent 
of a stationary Poisson arrival process: the number of packet 
arrivals N(t) in an interval of length t is binomial with 
parameter a £ [0,1]. The individual packet sizes Y(i) with 
index z = 1,2,... are independent and identically distributed 
(iid) geometric random variables with parameter /3 £ (0,1]. 
Parameter a has the interpretation of an average arrival rate 
and 1//3 is the average size of packets. For the special case 
of a system with constant service rate R = 1, a/p is the 
utilization and a < /3 is required for stability. 

We characterize the process using an upper envelope func¬ 
tion that is derived from its moment generating function 
(MGF). The MGF of a random variable X is defined as 
Mx($) = E[e eA ] for any 6. The respective MGFs of 
the above processes are Mjv(fM) = (cue ^ + 1 — a) 4 and 
M v (0) = Pe 9 /(1 - (1 - /3)e 9 ) for 6 £ [0, - ln(l - /?)) |22|. 
The cumulative arrival process A(t) is the doubly stochas¬ 
tic process A(t) = It has MGF M^(0, f) = 

Mjv(ln My(0), t) [ 181, (22) so that by insertion 

M ' l( *’ t) = ( i-a% e « + 1 -°) - (6) 

Using Chernoff’s theorem P[X > a;] < e~ 9x Mx(0) for 
9 > 0 and established methods of the stochastic network 
calculus ||12), (13) it can be showrj]] that the function 

A e (t) = (In Ma(0, t)+pt- ln(pe)) (7) 

is a statistical envelope function of A(t) that provides the 
sample path guarantee 


P[A(r,f) < A e (t — t), Vt £ [0,t]] > 1 - £ (8) 


for all t > 0. Above, £ £ (0,1] is a probability of overflow, 
and 9(t) > 0 and p £ (0, \/e\ are free parameter^] With 0, 
statistical performance bounds follow readily by substitution 
of .4 s (f — r) for A(r,t), e -g-> the backlog bound 0 yields 


P 


B(t) < sup {A £ (t 

tE [0,t] 


t) - S(t, t)} 


> 1 — £. 


(9) 


In Fig. [7] we illustrate the progression of the backlog 
bound 0 over time. The parameters of the service process 0 


1 We omit the proof as it is dual to the derivation of 0) and considers 
only the special case of a stationary process. 

2 Compared to related works, we use a time-variant parameter Q(t) instead 
of a constant 6. This allows optimizing 6(t) to minimize A £ {t) individually 
for each t, which facilitates a computationally efficient implementation. 






Fig. 1. Progression of the transient backlog over time. The time-variant 
service model correctly estimates the shape of the (1 — e)-quantile. 



Fig. 2. Impact of arrival rate a. and sleep cycle T on the backlog quantile. 


are T = 100 and R = 1. For the arrival process 0 we use 
a = 0.09 and (3 = 0.3 corresponding to a utilization of 0.3. 
We choose s = 10 -9 and optimize the free parameters 9 > 0 
and p £ (0, \/e] of 0 numerically. Also, we include a backlog 
bound from the deterministic network calculus, where the 
service Si nv (r , t) = R[t—T—T] + = Si nv (t—T) is a univariate 
time-invariant function that depends only on the width of the 
interval (t, t\. Otherwise, it considers the worst-case, that is 
attained for r = 0 where Si nv (t ) = S(0,t) from 0- Fig. [T] 
shows that both, the time-variant and the time-invariant service 
model, reveal the same growth of the backlog bound until 
service starts at T = 100. How the transient backlog is cleared 
after T and eventually converges to a stationary backlog bound 
is, however, only explained by the time-variant model. To see 
why the time-invariant model fails note that the sup in 0 is 
non-decreasing in t if S is a univariate function. 

Further, Fig. [T] includes the exact backlog quantile for 
comparison. For the discrete time Poisson model, the solution 
can be readily obtained from a discrete time Markov chain. 
The state of the Markov chain K(t) > 0 represents the number 
of arrivals that are in the system at t. For t <T the transition 
matrix Q(f) is composed of the probabilities q^ i = 1 — a, 
= a, and all other q-; j = 0. For t > T the service 
starts so that qty-i = (1 — a)/3, tfc,* = (1 — a)(l — (3) + a(3, 
qi,i+i = a(l — /3), and all other q l:? = 0. The Markov chain 
starts in state K( 0) = 0, i.e., the initial state distribution P(0) 
is the column vector (1,0,0,...). The state distribution for 
t > 0 follows by repeated insertion of P(f) = Q(f)P(f — 1). 

Clearly, for t <T the state distribution is binomial, whereas 
for t > T the distribution makes a transition and for t —> oc 
attains the geometric stationary state distribution [ 23| 


P[A'(oo) = k\ 


P-u f <*(1 - P) \ 

(3(1-a) V(1 -a)PJ 


The backlog distribution can be computed as 


The (1 — e)-quantile of B(t) is depicted in Fig. [T] We 
observe that the bound from the time-variant service model 
provides a good estimate that recovers the shape of the 
quantile. We note that the deviation is due to bounds that are 
invoked in the derivation of the Poisson envelope. While the 
network calculus literature includes envelopes for non-trivial 
arrival processes including self-similar, long-range depen¬ 
dent ]24) , [ |25| , and heavy-tailed processes [25], tighter mar¬ 
tingale bounds are available, e.g., for Poisson |26) , Markov, 
and autoregressive processes 03- 
Fig. [2]presents the impact of the arrival rate a for T = 100 
and the impact of the sleep cycle T for a = 0.15 on the 
backlog quantile. The remaining parameters are as in Fig. [T] 
The measures of interest © are the maximum overshoot 
compared to the steady-state and the relaxation time, i.e., 
the time that is required to reach within a defined range the 
steady-state backlog. Fig. 2(a) shows that a has a significant 
impact on both quantities. Interestingly, if a is large, the 
maximum overshoot occurs after T, i.e., during the transition 
from binomial to geometric state distribution. The relaxation 
time reaches values that are larger than T by an order of 
magnitude. 


B. Non-stationary Sen’ice Curves 

Next, we consider S(r,t) as a non-stationary random ser¬ 
vice process. We define a bivariate envelope function <S e (r, t) 
that conforms to 


P[5(r, t) > S e (t, t), Vr S [0,£]] > 1 — £ (10) 

for all t > 0 where e £ (0,1] is a probability of underflow. 
Adding A(t) to both sides we have 

P[A(r)+S'(r, t) > A(r)+ l S e (r, t), Vr e [0,f]] > 1 -e. (11) 

Since ( [TT| makes a sample path argument for all r £ [0, t], it 
follows that 


P[B(t) =b]=^2 P[B(t) = b\K(t) = k] P[K(t) = k] 

fc=t 

for b > 0 and P [B(t) = 0] = P [K(t) = 0] for 6 = 0. 
The conditional backlog in state k is the sum of k geometric 
random variables that is negative binomial, i.e., for fc,6>0 

P[B(t) = b\K(t) =k}= - Pf~ k - 


inf {A(r) + S'(r, £)} > inf {A(r)+ l S e (r, £)} > 1 —e. 

tE [0,i] tE [0,t] 

Using 0 we conclude that 

P[D(t) > A (g> S E (t)] > 1 — e. (12) 


We refer to S s (t. t) as non-stationary service curve. It extends 
the notion of effective service curve tm that defines | [T2| ) for 
univariate functions S E (t— r). Compared to |111, the definition 

















of a bivariate function S £ (r,t) provides a service guarantee 
that has the capability to consider transient changes over time. 

Next, we use the negative MGF, respectively, Laplace trans¬ 
form of 5(t, f) denoted M^(— 9,t, t) = E[e _es ^ T ’^] to derive 
a non-stationary service curve. We show that the function 

S e (r,t) = - . 1 , (In Mg(— 9, t, t)+p(t-T)-ln(pe)), (13) 
V\T, t) 

where 6{r,t) > 0 and p £ (0,1/e] are free parameters, 
satisfies the service curve guarantee m 

For completeness, we include the derivation of ( [T3| that ex¬ 
tends |27) to non-stationary processes. The derivation employs 
basic steps from the stochastic network calculus fl2| , G3- We 
use the complementary formulation of ( fT0| 

£ := P[3r £ [0,t] : S(r,t) < S £ (t, f)] < e. 

to prove that S £ (r,t) defined in satishes ( | 1 ()[ >, or equiva¬ 
lently that £ < £. Using the union bound and Chernoff’s lower 
bound P[X < x] < e 9x M x{~9) for 9 > 0 it holds that 

t-i t -l 

£ < E P [^( T ’ *) < *)] < E e e(r ’ t)5E(r ’ #) M s(-9, t, t), 

T —0 T—0 


where 9(r,t) > 0 is a set of free parameters. The case where 
t = t is omitted since S(t,t) = 0 and S £ (t,t ) < 0 by 
definition. By insertion of S £ (t. t) from (| 1 3[i it follows that 


t-i 


£<peE 


e p ^ = pe E e 

r —0 v=l 


/»oo 

pl ’ e~ pv dy = e 

Jo 


where each summand is bounded by e pv < /J_i e pvd v 
since e p,J is decreasing. Finally, letting t oc and solving 
the integral completes the proof that £ < e for all t > 0. 


Random Sleep Scheduling: We extend the deterministic 
sleep scheduling model from Sec. |II-A| and consider a non- 
stationary work-conserving system with random service incre¬ 
ments Z(t) for t > 0. When entering sleep state, the system 
regenerates and wakes up after a random time T > 0, i.e., 
Z(t) = 0 for t £ [0,T]. The service process is computed as 
S(t, t ) = YJ,v= t +i Z(v) for all f > r > 0 and S(t, t) = 0 for 
all t > 0 [10|." To derive the MGF of S(t, t), we first consider 
the number of usable time-slots in (r, f], i.e., after time T 

U(r,t) = [f — max{r, T}] + . 

The MGF of U (r, t) is composed of three terms 


M u(0,r,t) = 
s 0(t—Up [ T < t }+ E 


O 0(t-V)p\rp _ 


P[r = u] + P[T>t], ( 14 ) 


V=T -\-1 


that correspond to the cases where the start of the service 
T occurs before and including r, within (r, t], and after t, 
respectively. Given the service increments Z(t) for t > T are 
iid with MGF M z(9), the MGF of the service process is [221 

M s(0, T, t) = E[(M z{0)) u W] = Mj/(ln M z (0), r, t). (15) 



(a) r = (0,100,. .. } 



(b) t = (0,100,... } 


Fig. 3. Non-stationary service curves of random sleep scheduling. 


For a concrete example, we model T as a geometric random 
variable with parameter p, where P[T = v\ = p{ 1 — p) v , and 
Z(t) for t > T as iid Bernoulli trials with parameter q. Due to 
the memorylessness of the processes, solutions for this specific 
example may also be derived, e.g., from a Markov model. We 
use this example as it enables us to compute certain reference 
results in Sec. [Ill] Note that the service curve ( fi~3j ) in general 
is not limited to memoryless processes. 

Regarding ( [T4| > we have P[T < r] = 1 — (1 — p) T+1 and 

E eHt ~ v)p [T = v\ = e 8t p E (e- e (l -p)) V , 

V=T~\~ 1 V=T -\-1 

where we substitute y = e~ e (l — p) and compute 


E v v = 


„T +1 


,4+1 


V—T+1 


i -y 


Having obtained a solution of the MGF of the service 
process follows from © by insertion of M z (9) = qe e + l — q 
for a Bernoulli service increment process. Finally, the non- 
stationary service curve is computed from ( p~3| >. 

Fig. [3] illustrates 5 E (r, t) for p = 0.1 and q = 0.5. The 
remaining parameters of the service curve are e = 10 -6 , 
p = 10 -4 , and 9(r,t) is optimized numerically. In Fig. 3(a) 


we show how the service in an interval of width t —r increases 
with increasing distance r from the last regeneration point. 
For small r a significant impact of the initial transient phase 
is noticed. For large r we observe that S £ (r,t) converges 
towards a stationary service curve that is computed for a 
Bernoulli service increment process without sleep scheduling. 


Fig. 3(b) displays service curves for fixed t and variable r. 
Here, the transient phase is reflected in the non-convex shape 
of the curves, rightwards where r approaches zero. In contrast, 
the initial delay at the origin, that also applies to the stationary 
service curve, is caused by the Bernoulli service increment 
process. For small intervals t—r the process results in a service 
of zero with non-negligible probability. For t = 100 and for 
t = 200 the effects bring about a service curve of zero. 

The presentation of N E (r, f) in Fig. 3(b) conforms with the 
formulation of statistical performance bounds, where t is fixed 
and all r £ [0, t\ are evaluated. A statistical backlog bound 
follows from ( |1 2\ with ([8J as 

B(t) < sup {A £ (t — t) — S £ (t, t)} >1 — 2e (16) 

t£[0,£] 















A closely related research area 1331 is available bandwidth 


D (t)= inf {A(r) + 5(r,t)}. 

re[0,t] 


min-plus convolution has no inverse operation in general. A 
solution can, however, be obtained for certain arrival functions 
A(t) (33). Using measurements of S(r,t), we finally seek 
to estimate a maximal non-stationary service curve S £ (r,t), 
i.e., find a maxima^ function <S £ (r, t) that satisfies (12) . The 
measurements are performed assuming a regenerative service 


Fig. 4. Transient backlog and delay of random sleep scheduling, 
and a first-come first-served delay bound as 
P W{t) < inf{ w >0 : sup {A £ {t— t)—S £ (t, t+w)} < o} 

L L re[o,t] J 

> 1 - 2s. (17) 

Intuitively, the backlog and delay bound are the maximal 
vertical and horizontal deviation of A £ (t — r) and <S e (r, f), 
respectively. For illustration. Fig. 3(b)| includes the Poisson 
arrival envelope from Sec. II-A for a = 0.06, 3 = 0.3, 
and £ = 10" 6 . Corresponding backlog and delay bounds are 
shown in Fig. [4] for different parameters of the service p and 
q where the long-term utilization is a/((3q). The remaining 
parameters 9 and p are optimized numerically. Compared to 
the stationary case, the transient overshoot of sleep scheduling 
is considerable. 

III. Measurement-based Estimation 

Complementary to the model-based approach, methods for 
estimation of service curves from measurements of systems 
have received increasing attention in the past years 


process as defined in Sec. II-A where repeated network 
probes can observe samples of the service process Si(r,t) 
at regeneration point Pi as defined by ([3]). 

The remainder of this section is structured as follows: We 
adapt two known methods, rate scanning (Sec. pTUA) > and 
burst response (Sec. III-Bi, for estimation of non-stationary 
service curves. Fundamental limitations of these methods are 
identified that are explained by the non-convexity and the 
super-additivity of the service (Sec. III-C| >, respectively. We 
devise a new two-phase probing method (Sec. |III-D| that first 
determines the shape of a suitable probe, that is proven to be 
minimal under certain conditions. The probe is used to obtain 
a service curve estimate with a defined accuracy. 

A. Rate Scanning 

First, we consider the rate scanning method from (33), |351 


estimation that seeks to estimate the long-term average unused 
capacity of a system or a network. In passive measure¬ 
ments (28) , (33| the departures of a system are observed 
given the production traffic of the network, whereas in active 
probing |29 (— |36j artificial test traffic is injected into the 
system. The different approaches can be further classified 
to be based either on the assumption of a work-conserving 
system or more general min-plus systems |32’j— 

[ 36] and either use a deterministic model (30)-© or a 
stochastic model (28), (29) , (35), (36) . For a more detailed 
comparison see also While a method known as rate 

scanning is available for estimation of stationary service curves 
for the general class of min-plus linear systems with random 
service (35), [36), methods for estimation of transient service 
curves are not elaborated in the current literature. 

Like (32)-(36), we consider min-plus linear systems, 
where (T) holds with equality, i.e., for all t > 0 


that uses constant rate probes A(t) = rt for a set of rates r £ 
R. While [331 and [351 consider deterministic and stationary 
service curves, respectively, we adapt the method to provide 
estimates of non-stationary service curves for transient phases. 

For constant rate probes A(t) = rt the backlog of a system 
follows from © as B{t) = sup re[M {r(t- r) - S{r,t)}. 
Consequently, it holds that B(t ) > r(t — r) — S(r,t ) for 
all t £ [0, t], Solving for S(r,i) provides the lower bound 
S(r,t) > r(f — t) — B(t) for all r £ [0,£]. 

Next, we use the definition of (1 — £)-quantile 


= inf{x > 0 : P[X < x] > 1 — £} 


(19) 


(18) 


The unknown S(t, t) is a time-variant, random service process 
as in (35) , (36). Compared to (35) , (36) we do, however, 
not assume stationarity of S(t. t). Based on ©• the goal 
of service curve estimation can be phrased as an inversion 
problem, i.e., solving (~j~8) for S(t. t). Due to the infimum, the 


and denote IA (r, t) the backlog quantile at time £ as a function 
of r. A non-stationary service curve © follows as 

S £ s {t, t ) = max{r(f - r) - B^(r, £)} (20) 

for t > t > 0. By application of the union bound, S £ s (r,t) 
satisfies ( |T0) with probability e = Compared 

to (35) , (20) uses the transient instead of the stationary 
backlog to estimate a non-stationary service curve. The service 
curve that is defined by (20) has the form of a Legendre- 
Fenchel transform of the backlog (33). The Legendre-Fenchel 
transform has a number of useful properties in the network 
calculus (32), |37jj. It is also known as convex conjugate as 
the result is generally a convex function (38) . For convex 
functions, the Legendre-Fenchel transform is its own inverse, 
whereas the bi-conjugate of a non-convex function can only 
recover the convex hull of the original function (38) . 

In a practical implementation of rate scanning, the set of 
probing rates R has to be selected. Options are, e.g., linearly 
or geometrically spaced rates combined with suitable tests 

' Wc note that in general there is no unique maximal solution but only 
Pareto efficient solutions. 




























that determine the maximum probing rate |33| , |35[ . Then, 
estimates of the backlog quantile (r, t) for t > 0 are 
obtained from repeated measurements for each r £ R. A 
service curve estimate 5{ s (r, i) follows from ( [20] ). 

For evaluation of the method, we consider a simulation 
of the random sleep scheduling model from Sec. ( |II-B| ) with 
identical parameters p = 0.1 and q = 0.5, i.e., the stationary 
service rate is 0.5. We perform rate scanning with ten rates 
r £ {0.05,0.1,..., 0.5}. For each rate we obtain 10 s backlog 
samples from repeated experiments from which we extract an 
estimate of the backlog quan tile B ^(r, t) for £ = 10~ 4 5 so that 
e = ^}. rgR £ = 10 -3 . Fig. 5(a) shows the linear segments 
obtained by each of the ten probing rates r £ R and the 
resulting estimate 5{ s (t, t) for t = 200. 

As a reference, we include an analytical upper bouncj}] in 
Fig. |5(a)| Any function that exceeds the upper bound for some 
t £ [0, t] violates the definition of service envelope {TO} . 
Also, we show an analytical service curvc0 for comparison. 
Clearly, the service curve estimate from rate scanning cannot 
recover the non-convex parts of the analytical results as it is 
fundamentally limited to a convex hull by construction. 


B. Burst Response 

Motivated by the min-plus systems theory of the network 
calculus |9j, a canonical probe for system identification is the 
burst function 6(t) that is defined as 


J(t) 


0 for t = 0, 
oo for r > 0. 


( 21 ) 


In min-plus algebra, the burst function takes the role of the 
Dirac delta function, i.e., it is the neutral element of min-plus 
convolution. Consequently, sending a burst probe A(t) = 6(t) 
reveals the service 5(0, t) for all t > 0 as the burst response 
of the system 


D(t) = inf (<5 (t) + 5(r, t)} = 5(0, t). (22) 

re[0,t] 


For additive service processes as defined in 1 15 p. 6], 5(r, t) 
can be obtained for all t > r > 0 as 


5(r, f) = 5(0, i) — 5(0, r). (23) 

For a stochastic analysis, we denote fl the set of all feasible 
sample paths D^pt). For each ui £ fl we use the additivity {ZT} 
to obtain the service process from the burst response ([22} as 

S u {t, t) = D u (t) - D u (t) 

for all r £ [0, t\. We fix t > 0 and select a subset of the sample 
paths C !1 with probability P[\& t ] > 1 — e. By definition 
of 

Strait) = inf {5^(r,f)}, (24) 


4 For a Bernoulli service increment process with parameter q that starts after 
a geometrically distributed time T, an upper bound of the service provided 
in [t, t] is derived as the (1 — e)-quantile of a binomial distribution with 
parameters t — max{r, T} and q. We note that the first parameter, i.e., the 
number of trials t — max{r, T}, is a random variable. 

5 The analytical service curve again uses the binomial distribution but makes 
a sample path argument using the union bound in addition. 



(a) Rate scanning (b) Burst response 

Fig. 5. Service curve estimates compared to analytical results. The estimate 
from rate scanning is the maximum of linear rate segments (dashed lines). 
By construction it can only recover a convex hull. Burst probing can estimate 
non-convex service curves and performs close to the analytical upper bound. 


it holds that 5^,(r, f) > S^ r (r, t) for all r £ [0, f] and all 
ip £ T't. Further, we have P[\D t ] > 1 — e so that Sp ir (r, t) 
satisfies {TO}. Hence, Sp )r (r, t) is a non-stationary service curve 
that conforms to ( |1 2} . 

In a practical probing scheme, we can only observe a finite 
set of sample paths O from repeated measurements of the 
departures D u (t) for t > 0. We fix t > 0 and estimate the 
service 5 aj (r, t) = — for all r £ [0, f] and to £ fl. 

To construct d/ t we remove a set of minimal sample paths from 
il. We define the minimal sample path <p to be the sample path 
that attains the minimum 


5 n 


i(T,f) = min{5^(r , t)} 

u;6f2 


for r £ [0,t] most frequently. That is </> = argmax^gnjX^}, 
where for all uj £ V. 

t -1 


T —0 




The indicator function 1 . j is one if the argument is true and 
zero otherwise. We remove <p to obtain 'f , = f l\<p and repeat 
the above steps for T, as long as P [ T, ] > 1 — e. Finally, we 
obtain the service curve estimate from {24} for all r £ [0, f]. 

Fig. 5(b) shows service curve estimates from burst probing 
for t = 200, 300, and 400 together with analytical upper 
bounds and analytical reference service curves for the same 


system as used for Fig. 5(a) We observe that burst probing 
performs very well as it provides service curve estimates that 
closely follow the analytical upper bound. 

Despite its good performance, burst probing has, however, 
limitations. Particularly, we discover that the intuitive assump¬ 
tion of additive service processes j 15), that is a basis of the 
method, is not justifiable in general. A notable exception are 
networks of systems, where the end-to-end network service 
process S net (r,t ) = 5 1 ( 8 ) 5 2 ( 8 ) ■ • • ® 5"(r, f) is derived by 
min-plus convolution of the service processes of the individual 
systems 5*(r,f) for i = 1,2, ...n. For additive 5®, the 
following Lemma [ 2 ] proves that S net is super-additive in 
general and additive only in certain special cases. The result is 
significant since it refutes the assumption of additive service 
processes for the large class of tandem systems. It implies 
that the burst probing method is too optimistic as it estimates 
5” et (r, t) = S net (0,t) - 5 net (0,r) from {23} whereas in 













general only S net (T,t) < S net (0,t) - S net (0,r) holds due 
to the super-additivity of S net . Besides, burst probes can 
be considered intrusive as they cause non-linear behavior 
of certain systems [(33) . An important example are FIFO 
multiplexers, where a burst probe can preempt other traffic, 
resulting in a too optimistic service estimate. 


C. Super-additivity of min and 0 

The burst response method in Sec. III-B is applicable to 
additive service processes. The following lemmas show that 
the min and 0 operators in general maintain only super¬ 
additivity but not additivity. A function /(s,f) is super¬ 
additive if f(s,u) > f(s,t) + f(t,u) for all u > t > s > 0. 
Trivially, an additive function f(s,u ) = f{s,t ) + f(t,u ) for 
all u > t > s > 0 is also super-additive. 


Lemma 1 (Super-additivity of min). Given two super-additive 
bivariate functions f(s,t) and g(s,t) for t > s > 0. The 
minimum h(s,t ) = min{/(s, f),g(s, f)} is super-additive. 


We note that the minimum of two additive bivariate func¬ 
tions f(s,t) and g(s,t) for t > s > 0 is super-additive, as a 
special case of Lemma [I] but in general not additive. A coun¬ 
terexample is f(s,t ) =t — s and g(s,t) = 2([i/2j — [_s/2J). 
Clearly / and g are additive, however, h = min{/, g} is not. 

Proof of Lemma [/} By definition of h we have 

h(s, t ) + h(t , u ) 

= min{/(s, t), g(s, t)} + min{/(f, u), g(t , u)} 

< tnm{f(s,u),g(s,u),f(s,t)+g{t,u),g{s,t) + f(t,u)} 

< h(s , u ). 


In the second line we used the super-additivity of / and g 
and in the third line min{/(s, u), g(s, it)} = h(s,u) and 
min{/!.(s, u), x} < h(s,u) for any x. ■ 

Lemma 2 (Super-additivity of 0). Given two bivariate func¬ 
tions f{s , t) and g(s, t) for t > s > 0 where f(t , t), g(t, t) = 0 
for all t > 0. Define h(s , t ) = / 0 g(s , t). 

i) If f and g are super-additive, then h is super-additive. 

ii) If f and g are additive and univariate, then h is additive. 

We note that the convolution of two additive bivariate func¬ 
tions f(s,t) and g(s,t ) for t > s > 0 is super-additive, but in 
general not additive. As a counterexample consider the addi¬ 
tive functions /(s,f) =t — s and g(t,u) = 2([m/ 2J — (_t/2J) 
for which h(s,u) = f ®g(s,u) = 2\u/2\ — s is not additive. 
To quantify this effect, we define the maximal deviation of a 
super-additive function h(s, u ) from additivity as 


A(s, u) := h(s, u) — inf {h(s, t) + h(t, u)}. (25) 

te[s,u] 

Additivity is, however, achieved in case of univariate functions, 
where Lemma [2] ii) extends a result for min-plus convolution 
of sub-additive univariate functions @ p. 142]. 

In Fig. |6(a) we evaluate the network service process 
S net (r , t) = S' 1 0"'0S"(r,() for a tandem of n = 2, 3,4 


systems with random sleep scheduling as in Sec. II-B i.e., the 


service processes S l (T,t) are additive. We consider 10 s sam¬ 
ple paths and show the distribution of the relative deviation of 
S' net (0,400) from additivity, i.e., A(r, t)/S net (r, t). Fig. 6(a) 
confirms significant deviations from additivity. 

Proof of Lemma [2f By definition of h we have 

h(s, t ) + h(t, u) = f 0 g(s, t) + / 0 g(t , u) 

= inf inf {f(s,T) +f(t,v)+g(r,t)+g(v,u)}. (26) 

r6[«,t] KE[t,u] 

i) Given / and g are super-additive. From ( |26| ) we have 

h(s, t ) + h(t, u) 

< inf inf {f{s,v) - f{r,t) + g{r,t) + g(v,u)} 

re[s,t] «6[t,u] 

= inf {f(s,v)+g(v,u)}+ inf {g(r,t) - f{r,t)} 

re[s,t] 


< inf Af(s,v) +g(v,u)}. 

vE[t,u] 


(27) 


In the first line, we estimated f(s,r) + f{r,t ) + f(t,v) < 
f(s,v) due to the super-additivity of /. In the second line, 
we rearranged the infima, and in the third line, we estimated 
inf TE[s,t]{ 9 ij,t) - f{r,t)} < g(t,t) - f(t,t) = 0 since 
f(t,t),g(t,t) = 0 for all t > 0. Similarly, using the super¬ 
additivity of g we derive from |26) that 

h(s,t) + h(t,u)< inf {f{s,T)+g{r,u)}. (28) 

r6[a,t] 

Combining ([27]) and ([28]) we obtain 


h(s,t) + h(t,u) < inf {f(s,T)+g(T,u)} = h(s,u), 

tE [s,m] 

which proves the super-additivity of h. 

ii) For the special case of univariate functions f(s,t) = 
f(t — s) and g{s,t) = g(t — s), that depend only on the 
difference t — s and not on the absolute values of s and t, it 
follows that h(s,t) = f®g(t—s) = h(t — s) is also univariate. 
Using the additivity of / and g, ([26]) yields that 


h(t — s) + h(u — t ) 
f ,{/(7 

:,u\ 

,{/(? - s ~ t) + g(t + u - ?)} 


= inf inf {f(T — s + v — t)+g(t — T + u — f)} 

rG[s,t] vE.[t,u] 

= inf 

s£[s-\-t,t+u] ' 

= inf {f(g)+g{u-s-g)} = h(u-s) 

<;E[0,u-s] 


which proves the additivity of h. ■ 

D. Minimal Probing 

Next, we devise a new probing method to characterize the 
transient behavior of service curves that are neither convex 
nor additive. The method comprises two phases. In the first 
step, the method estimates a minimal probe as well as an 
upper bound of the service curve from burst probing. In the 
second step, the minimal probe is used to estimate a non¬ 
stationary service curve with a defined accuracy. We show that 
the minimal probe can reveal the service of the system, ideally 
without causing backlogs. The importance of the probe traffic 


intensity is also discussed in [331 and estimation methods for 


stationary systems that use minimal backlogging are [291, 
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(a) Deviation from additivity (b) Accuracy of minimal probing 


Fig. 6. Network of n systems with random sleep scheduling in series, (a) 
The network service process deviates from additivity, (b) Minimal probing 
achieves small backlogs, corresponding to a high accuracy of the estimate. 


1) Estimation using Arbitrary Probes: First, we consider 
how to obtain a service curve estimate from an arbitrary probe. 
The estimate will then be used to derive conditions for the 
shape of a minimal probe. From ( p~8j ) it follows that D{t) < 
A(t) + 5(r, t) for all r £ [0, t] so that 

S(r,t) > D(t) — A(t), (29) 

for all r £ [0, t}. An equivalent expression using the backlog 
is 5(r, i) > A(t, t) — B(t ) for all r £ [0,t], By insertion of 
the backlog quantile it follows that 

S £ (r,t) = A(r,t) — B £ (t) (30) 

satisfies © i-e., S £ {r,t) is a non-stationary service 
curve m For the special case of A(t, t) = r(t — t) the 
rate scanning method is recovered. 

2) Definition of Minimal Probes: So far, we did not con¬ 
strain the shape of the probes and defining a suitable probe 
is non-trivial. Intuitively, a too small probe will provide little 
information about the service as the observed departures are 
mostly limited by the arrivals J33) . A too large probe, on the 
other hand, will deteriorate the estimate, e.g., in the extreme 
case of a burst probe A(t) = <5(r), the lower bound in ( 129! 
will only be useful for r = 0 but not for r > 0. The 
same restriction applied to burst probing earlier. Consequently, 
we seek to find the minimal probe A mp (r) that satisfies 
D(t) = inf re [ 0 ,t]{Anp(T) + 5 (t, f)} = 5(0, t) for a fixed 
t > 0, i.e., the minimal probe that allows estimating the service 
from observations of the departures. The minimal probe is 

A mp (r) = 5(0,f) - 5(r,f) (31) 

since any function A(t) for which 3r £ [0, t] : A(t) < 
A m p(f ) will only reveal D(t) < 5(0, t). We note that A mp (r) 
maximizes the right hand side of ( [29] ), where {TH] confirms 
that D{t) — A mp (r) = S(r,t). For any other larger or smaller 
probe A{t) = A mp (r) + f(r) it holds that D(t) — A{t) = 
S(r,t) + inf ve[0tt] {f(v)} - /(r) < 5(r,f). 

Since A mp (r) depends on the unknown service, it cannot 
be constructed a priori. To gather information that facilitates 
estimating A mp (r), we initially consider the system’s burst 
response D(t ) = 5(0, t) for A(t) = S(t). An estimate of © 
is A mp (r) = 5(0, r) that is exact if 5 (t, t) is additive. In the 
stochastic case, we use S^ r (r,t) from © to estimate 

Ampir) =5£ r (0,f)-5b r (r,f). (32) 


We note that additivity of 5| r (r, t) cannot be assumed by 
construction of ( [24] ), see Lemma |T] 

5) Accuracy of the Estimates: We start the investigation for 
a time-variant but otherwise deterministic system, where ( [29] ) 
provides a lower estimate of the service. Given the probe 
Amp{f) = 5(0, t), where 5(0, r) is obtained as the system’s 
burst response. By insertion into ( [29] ), a lower estimate is 

5(t, t) > inf {5(0, v) + S(v, t)} - 5(0, r), 

ue[o,t] 

where we used ( fT8] > to compute D(t) for A mp (r). On the 
other hand, the burst response provides the upper estimate 
5(r, t) < 5(0, t) — 5(0, t) if 5(r, t) is super-additive. Taking 
the difference of the upper and the lower estimate, the service 
process is bounded in an interval of width 


A(f) = 5(0,f)— inf {5(0, v) + S(v, t)} 

ve[o,t] 

that is the maximum deviation of 5(0, t) from additivity as 
defined in {25]. Further, using A mp (t) = 5(0, t) and {18}, 

A(f) = A mp (t) - D(t) = B(t), 


i.e., the estimation accuracy can be directly seen from the 
backlog at the end of the probe. Consequently, if 5(t, t) is 
additive, A(f) = 0, i.e., both the lower and the upper estimate 
recover 5(r, t) exactly and the backlog B{t) that is caused by 
A m p(f) is zero during the entire probe, i.e., for all r £ [0, t]. 

In the stochastic case, we obtain a non-stationary service 
curve estimate from © as 5^(r,f) = A mp (r,t) - B e (t) 
using the projre defined in {32]. By use of {32] we have 
A mp (T,t) = A mp (f)-A mp (r) = 5^(r,f) since S% r (t,t) = 0 
by definition. Note that we do not assume additivity of 5(r, /:), 
so far. By insertion into {30], it holds that 


S^ p (t, t) = Sl r {r, t) - B £ (t). (33) 

We conclude that B £ (t) observed by minimal probing is a 
measure of accuracy that separates the conservative estimate 
of minimal probing from the possibly too optimistic estimate 
of burst probing. 

To investigate B £ (t), consider the backlog expression 
B(t ) = sup Tg j 0 4 i{A(t, f) — 5(r, f)} that is derived from {18] , 
By insertion of {32] we have B(t) = sup rg [ 0 t j{5f r (r, f) — 
5 (t, t)}. By definition {24] , 5{ r .(r, t) = inf^ E ^ t {5^(0, t) - 
5^(0, t)} so that for any sample path ip £ Th 

B<p(t) = sup { inf {5^,(0, f) - 5^,(0, r)} - 

re[o,t] J 

< sup {5 v (0,f) - 5 v (0,t) - S v (r,t)} 

T£[0,t] 

= S lp (0,t) - inf {5^(0,r) + S v (T,t)}, 

r£[0,t] 


i.e., B p (t) is bounded by the maximal deviation of 5^,(0, t) 
from additivity. Finally, if 5(t, t) is additive, it follows that 
B v (t) = 0 for all <p £ T'j. Since P[4/ t ] > 1 — e it holds that 
B £ (t) = 0 and 5^ p (r, t) recovers S§ r (r,t) exactly. 

Fig. |6(b) quantifies the distribution of B(t) that is observed 
by minimal probing at t = 400. A network of n = 1... 4 







systems in series, each with random sleep scheduling as 
in Sec. II-B is considered. The network service process is 


additive for n = 1, but not for n > 1 as confirmed by Fig. 6(a) 


Since in general, it is not known whether the service process 
is additive or not, estimates of burst probing are not reliable. 
Using minimal probing, we can either if B e (t) = 0 confirm the 
estimate of burst probing or otherwise obtain a conservative 
esti mate with a defined accuracy that is given by B e (t). In 
Fig. 6(b) we observe that B e (t) > 0 for e = 10 -3 and n > 1, 
i.e., the estimate from burst probing is not confirmed. B e (t) 
is, however, small, i.e, minimal probing is accurate. We omit 
showing further service curve estimates of minimal probing 
since, except for the additive offset B e [t), they generally 
match the estimates of burst probing as determined by (|33]l. 


IV. Conclusions 

This work contributed a notion of non-stationary service 
curves to the stochastic network calculus. We analyzed sys¬ 
tems with sleep scheduling and provided insights into the 
transient behavior. Noticeable transient overshoots and large 
relaxation times were observed that have a significant impact 
on network performance. Due to its generality, the service 
curve model can include a variety of further systems. Beyond 
modelling, we considered measurement-based methods for 
identification of systems. We discovered that existing probing 
methods cannot accurately estimate non-stationary service 
curves. The difficulties were related to the non-convexity and 
super-additivity of the service. We devised a novel two-phase 
method that first estimates a minimal probe that is used in 
a second step to obtain an accurate service curve estimate. 
Simulation results confirmed the fidelity of the approach. 
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